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This paper provides exact expressions for the expected degree distribution of a given network that 
is subject to growth, as a function of time. We consider both uniform attachment, where incoming 
nodes form hnks to existing nodes selected uniformly at random, and preferential attachment, when 
probabihties are assigned proportional to the degrees of the existing nodes. We consider the cases 
of single and multiple links being formed by each newly-introduced node. The initial conditions are 
arbitrary, that is, the solution depends on the degree distribution of the initial graph which is the 
substrate of the growth. Previous work in the literature focuses on the asymptotic state, that is, 
when the number of nodes added to the initial graph tends to infinity, rendering the effect of the 
initial graph negligible. Our contribution provides a solution for the expected degree distribution 
as a function of time, for arbitrary initial condition. Previous results match our results in the 
asymptotic limit. 



I. INTRODUCTION 



Previous Work: Network Growth 



The complex network literature spans various 
strands of research such as sociology [IHS], eco- 
nomics [U [5|, computer science 6-8 , marketing [P- 
[T^ . epidemiology [13, 14 , genetics [ISj, and bibliomet- 
rics [TB]. These domains aim to extract macro-scale 
behavior from given micro-scale interactions.. 

The structure of the underlying graph, which con- 
nects the agents and consequently regulates their in- 
teractions, is necessary for studying the dynamism 
of various phenomena, such as flow of information 
(news, rumors, trends, etc.) in the society [T71 [T5] . 
resilience against node or link failures (for the inter- 
net, it means survival of the system if certain nodes 
are shut down) [19l [20], pace of diffusion of a conta- 
gious disease throughout a population and also optimal 
immunization strategies (21n23) . the effect of the net- 
work structure among actors on their chance of winning 
awards p4! , to name a few. Models have been proposed 
to emulate different structural properties observed in 
real life graphs 



In many applications, such as the world wide web [35l 
and scientific collaborations [37], networks are dy- 
namic, that is, subject to growth. This provides mo- 
tivation to view the problem of network formation dy- 
namically. In this formulation, nodes are introduced 
successively, and they select from existing nodes whom 
to attach to. It mimics, for example, the mechanism 
by which new papers cite existing ones. [34] takes this 
approach. Also, in [38ti4l] the problem is tackled by 
the conventional techniques of polymer physics. Both 
of these approaches employ approximations to solve the 
problem. In what follows, we go over these approxima- 
tions and the corresponding results. 



In [S3], the growth process starts from a small num- 
ber of mo nodes. Then, nodes are introduced one per 
unit time. Each node picks m < mp existing nodes 
to link to, with probabilities assigned to them propor- 
tional to their degrees. This means that an existing 
node with a higher degree will be more likely to attract 
the newly-introduced node. Denote the degree distri- 
bution of the graph when the total number of nodes is 
N by pk (N) . Note that t and A'^ are interchangeable in 
this scheme, since nodes are introduced one at a time. 
Their result can be expresses as follows: 



N 



lim pkiN) - fe- 



ci) 



The analysis is done within the mean-field simplifi- 
cation and the solution is valid in the asymptotic case 
of t — >■ 00. In [30], this result is ameliorated by refor- 
mulating the problem more rigorously, perhaps more 
congenial to the fastidious reader. Denote by /3 the 
number of links that each newly-born node emanates to 
the existing nodes. The process starts from a 4— cycle. 
Let Pk{N) be defined as above. Also, define: 



def 2(/3)(/3+l) 
k{k + l){k + 2)' 



(2) 



The authors show that(Theorem 1 in [30 
< — > oo, for any positive e and for < /c 
following holds: 



I in the limit 

< iVl/^ the 



(1 - e)a/3,fe < PkiN) < (1 + e)a^,fe. 



(3) 



Note that the expression in ^ agrees with ([T]) for large 
values of k. 

The problem is also closely related to the so-called 
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Polya's urn problem [42^ in combinatorics. Given a fi- 
nite number of bins, additional balls arrive one at a 
time. With a given probability, a new bin is created for 
the new ball. The ball otherwise joins an existing bin. 
It picks the destination bin with probabilities depen- 
dent on the existing number of balls within the bins. 
In [32] , the case where probabilities are proportional to 
rri^ is solved, m = 7 is akin to the linear preferential 
attachment scheme mentioned above. 

A novel way to tackle the problem was presented 
in 133] by employing the master equation ap- 

proach which authors borrow from polymer physics. 
The authors obtain ( p|) f or the case oi 13 — 1 (equa- 
tion (2) in[Mj, (5) in [32, (2) in [S^ and (2) in [31]). 
For a treatment of finite size effects (when N is not 
infinitely large) with primary focus on nodes with de- 
gree fcmax ~ V^, see [35 • Also, in [SS], the uniform 
attachment scheme is also examined. This means that, 
new nodes attach to existing nods with equal proba- 
bilities, regardless of their degrees. If we start from a 
single node at the outset, the resulting graph is called 
a Random Recursive Tree (RRT). The result presented 
in [3S] for the asymptotic degree distribution of RRTs 
is as follows: 



The same result is also presented in Theorem 1 in|44| 
and equation (49) in |45) following a combinatorial ap- 
proach. 



B. Exact Solution, Motivation 

Previous work has been primarily revolved around 
the asymptotic degree distribution, that is, when the 
number of nodes tends to infinity. Also, in some case, 
further simplification is acquired by limiting the range 
of degrees. For long times, the effect of the initial graph 
is neglected. In this contribution, we start from an ini- 
tial graph with known degree distribution rik ■ We solve 
for the expected degree distribution at time t. We con- 
sider both uniform and linear preferential attachment 
(eventuating in a scale- free graph in the long run) . The 
exact solution, first develops intuition about the growth 
process, and the path that the system undergoes until 
it reaches the steady state. More importantly, the ef- 
fect of the initial conditions is taken into account. Dif- 
ferent substrates reach the equilibrium approximation 
of the degree distribution which is at hand, with dif- 
ferent paces. The exact solution illuminates the effect 
of the initial condition on the accuracy of the above- 
mentioned approximations. 

Equipped with the exact solution, one can also ex- 
amine the short-time behavior, in marked contrast with 
the convention, which limits the solution to the long- 



time behavior. As an example of how the need for 
extracting the short-time growth of an existing graph 
is elicited in realistic applications, consider the network 
of supporters in a political campaign. Nodes are fanat- 
ics who absorb new people into the campaign, causing 
the network to expand throughout the potential elec- 
torate. The change in the network of followers in one 
day is not substantial compared to the existing size of 
the network. As another example, consider the social 
network within a country, with a small number of immi- 
grants joining and enlarging the network. The number 
of immigrants typically constitutes a small fraction of 
the population of the host country (with possible ex- 
ceptions of wars or other abrupt phase transitions, to 
minor degrees). Then, if one wants to study the social 
network of the host country, the conventional models 
cease to perform, because the fraction of new nodes to 
existing nodes does not tend to infinity, but is small. 
The same is true for any slowly-growing realistic net- 
work where the extrapolation of the near future pro- 
vided information on the current state is called for. 



C. Organization of the Paper 

First in subsection III Al we consider the uniform at- 
tachment scheme, with each newly introduced node 
linking to one existing node picked uniformly at ran- 
dom. We compare our results with the ones present 
in the literature. Then in subsection IIIBI we consider 
the uniform attachment for multiple linking, where each 
new node connects to /? existing nodes drawn uniformly 
at random. In |III| we examine the preferential attach- 
ment scheme. First in llll Al we consider each new node 
linking to only one existing node with probabilities as- 
signed to existing nodes proportional to their degrees. 
Then in |IIIB| we assume each new node attaches to f3 
existing nodes. So each new node has degree /? upon 
birth. We solve for the expected degree distribution 
in all cases. Throughout the paper, we compare our 
theoretical findings with simulations. 



II. UNIFORM ATTACHMENT 

A. Single Connection 

We start from an initial connected graph at time 
t = with A^(0) nodes. We denote the degree dis- 
tribution at the outset by rik- At each timestep, a new 
node is introduced. It picks one of the existing nodes 
uniformly at random and connects to it. Let a repre- 
sent the rate at which new nodes are introduced, that 
is, a At nodes are added in a time interval of duration 
At. Nodes are added one by one (if the initial condition 
is a single node, the resulting graph will be the conven- 
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tional Random Recursive Tree [3Sl HH ) ■ At time t 
there are N{t) = N{0) + at nodes. Let Nk{t) denote 
the expected number of nodes whose degree is k at time 
t. Let us focus on the expected variation in Nk(t) in an 
infinitesimal time increment At within which aAt new 
nodes are added. 

With probabihty ^^^j^, a node with degree k re- 
ceives a link, and its degree increments. Consequently, 
Nk decrements and Nk+i increments, both by one. 
Similarly, with probability "^[Z)^*'' , a node with de- 
gree k — 1 receives a link, hence Nk decrements and 
Nk^i increments, both by one. So we have: 

Note that the case of /c = 1 is distinct. Each new node 
increments iVi by one. So, 



by an unknown integrating factor ^{z,t) to make both 
sides equal to ^\ji{z^t)ip{z,t)\. Then ii{z,t) is found 
to be exp[Jp(z, t)dt]. Thus the final solution becomes: 



^P{z,t) 



fi{z,t) 



fj,{z, t)q{z, t)dt + C{z) 



(12) 



where C depends on the initial conditions. In our prob- 
lem, the initial degree distribution is given and it will 
be used to determine C^- For fJ.{z,t) we have: 



z) = exp 



- 1) 



dt 



Ni{t + At) - Ni{t) = -aAt- 



Ni{t) 



N{0) + at 

These two equations can be condensed into one: 



+ aAt. (6) 



7V(0) + at 
= exp (l-z"i)ln[iV(0) + at 

= [N{0)+at]'^^~'''\ 
Using this and (|l2|) , wc find ip{z,t) as follows 



(13) 



J 1[N{0) + atY^-^ '^dt + C, 



[iV(0) -f 



(14) 



Nk{t + At)-Nk{t) 



aAt 



N{Q)+at 



[Nk-i ~ Nk) + aAt5k,i, 
(7) 



Note that the constant depends on z. Carrying out the 
integral, we arrive at: 



where 5k,i is the Kronecker delta function (i.e., 5k,i = 1 
if A; = 1, and 5k,i = otherwise). Dividing both sides 
by At and taking the limit t — >■ 0, we get the following 
differential equation for the dynamics of the expected 
degree distribution: 



^(M) = »^ + a(iV(0)+aO-^ 



(15) 



The constant is obtained by looking at t = 0, when 
the following holds: 



Nk = 



iV(0) + at 



{Nk-i ~ Nk) + aSk,i, 



(8) 



^iz,0) = -^^^+C.NiO)^-\ 



(16) 



where Nk is the first derivative of Nk{t) with respect 
to time, and explicit dependence on time is omitted for 
expositional simplification. 

To solve (|8|, we use the generating function ■(/;(z, t) 



Solving this for Cz and plugging the result in ( 15 ) yields 
iV(0) + at 



i,{z,t) 



z ''Nk(t), which is the conventional Z-transform in 
the k domain. Using ([s]) we get 

d^{z,t) 



NjO) 

z(2-i) N{0)+at 

iV(0)2 1 



^iz,0){l + 



at \ ' 



dt 



Nwr^t^^-'^'^^^^^^'^^"^- 



iV(0) + at z{2 - 
To take the inverse transform, first note that: 

1 



So we intend to solve the following differential equation 
in the time domain: 

This equation has the following general form: 

iP+p{z,t)i> = qiz,t), (11) 



X/ 9' 



.-fc 



k=l 



2k' 



Also, denoting -j^^ by A, note that we have: 



(1 + A)^ 



ln(l + A) 



at 1 
iV(0)^' 

(17) 
(18) 
(19) 



whose solution is straightforward. Multiply both sides 
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Using the Taylor expansion of the exponential, we get: 

1 k 



[ln(l + A)]' 



fc! 



(20) 



fc=0 



So the inverse transforms are: 



1 1 

5 > —rUik — 1) 



ln[l 



at 1 
7V(0)J 



(21) 



fc! 



Where u{x) is the Heaviside step function (i.e., u[x) — 
for X < 0, and u{x) — 1 for x > 0). Finally, note that 
the multiplication of Z-transforms yields convolution 
after inversion. Let us denote the degree distribution 
of the initial graph by rife, that is, rife is the fraction of 
nodes at the outset with degree k. Thus inverting (17 1 
gives: 



Nk{t)^^^^ u(k-\) 



2k 



N{Q) + at 
N{Q) + at 



In 1 



(l + JvTo)) 



fc! 



u{k-l) 
2fe 



In 1 



N{0) 



kl 



(22) 



where * denotes the convolution operator. To get the 
degree distribution, we divide this result by the total 
number of nodes at time t, which is equal to A^(0) + at. 
So we obtain: 



Pk{t) 



u{k- 1) 

" 2k 

A^(0) 



iV(0) + at 



( mo) 

\N{0)+at 



rife * 



In 1 



at 
N{0) 



k\ 



u{k - 1) 



In 1 



(l + N{0)) 



kl 



(23) 



As i — > oo, the effect of initial conditions vanish. So 
the first term dominates. In this limit, the asymptotic 
degree distribution is: 



lim pk{t) = ^ 



(24) 



theoretical 

• simulation 




FIG. 1: Degree distribution at time t = 60. The initial graph is 
4— regular with N(0) = 30 nodes. Growth is under uniform 
probabilities and single attachments. At each timestep, one 
node is added, so a = 1. The results are averaged over 20 
Monte Garlo trials 




FIG. 2: Growth under uniform probabilities and single 
attachments, on a ring of 50 nodes. The fractions of nodes 
having degree 3,4,5,6 are depicted in time, a = 1 is used. The 
results are averaged over 20 Monte Carlo trials 



Note that this matches the asymptotic behavior previ- 
ously found for RRTs as presented in US] . 

To compare theoretical prediction with simulation re- 
sults, first we start off with a 4 — regular graph. This 
means that all nodes have 4 neighbors. We build this 
graph by first making a ring of 30 nodes, and then con- 
nect each node to two second closest neighbors. Fig. ([T]) 
shows the degree distribution at time t — 60, that is, 
Pk{t — 60). The results are averaged over 20 Monte 
Carlo trials. Also, a = 1, so nodes are introduced one 
at a time. 

For the next simulation, we take a ring of 50 nodes 
and we plot Pfe(i) as a function of time, for fc = 3, 4, 5, 6. 
The simulations and theoretical results are shown in 
Fig. ^. 
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B. Multiple Connections 

Now, let us consider multiple attachments. Each 
new node that is introduced, chooses /3 existing nodes 
(where /3 > 1 is an integer) uniformly at random and 
links to them. An essential difference of this scheme 
from the previous one is that, if one starts from a dis- 
connected graph, then the probability of ending up with 
a connected graph is nonzero. This probability was zero 
in the previous case, because each newly-introduced 
node only linked to one existing node and could not 
make a connection between two disconnected compo- 
nents. 

Taking the similar steps that led to ([T]), the change 
in Nk{t) is given by: 

Nk{t + At)-Nk{t) = -^^^(Affe_i-iVfe) + aAt4,^. 
A'(O) -I- at 

(25) 

Note that the last term indicates that each new node 
adds one to A^/j, because its degree is /3. Dividing by 
At, the differential equation for Ni,{t) becomes 



N{0)+at 

Taking the Z-transform, ([9| now takes the form: 



(26) 



-(z-i-l)^(^,t) + 



dt N{0)+at''~ -J-ry-^-j • ^p- 

The following differential equation must be solved: 

N{0)+at 
The integration factor is: 

/ ^ r f Pa(z-^ - 1) 

lj{t, z) = exp ' 



a 



(27) 



(28) 



exp 



. , dt 
N{0) + at 

/3(1 - z-'^)ln[N{0) + at] 



[N{0)+atf^^-'' '\ 



(29) 



And from (12) , 'ip{z,t) is obtained: 

/^[Ar(0) + at]'3(i-^"')di + C, 

ij{z,t) = 



[N{id) + atY'^^—-') 
After integration, we get: 

1 A(0) + at C,_ 



(30) 



i^{z,t) = 



zfn + Pil-z-^) [N{0) + atf'-^'' 



(31) 



Setting t = 0, we find C^: 



^(z,0) 



N{0)z-^ 
l + /3(l-z-i) 



NiO) 



f3{l-z-^) 



(32) 



Substituting this Cz in (31 1 yields 



i^{z,t) = 



1 N{0) + at 
^1-^/3(1-2-1) 



i^(z,0) 



^(0) 



1/3(1-^-') 



N{0) + at 
N{0) 



z'3[l+/3(l-z-i)] 



A^(O) 



N{0)+at 



(33) 



Now we must invert this, term by term. First, note 
that: 



1 



z/'[l + /3(l-z-i)] + 
Now, by definition, the inverse Z-transform is given by: 



1 



(34) 



Nkit) = ^ <l>Hz,t)z''-'dz 



= (i+/3r 



-dz. 



(35) 



In order to perform the integration, one must find the 
residuals of ^ g |46l|47j. For this purpose, we have 
to assume three distinct cases: 



• It k — /3, then we are looking for the residuals of 
— which is unity. 



• If fc > /3, then the only pole is at z = and 



the residual becomes [^j^]*^ ^■ 



• If A; < /3, then z = is also a pole, and is of order 
/3 — fc. The residual at this pole is equal to the 
following: 



1 



1 







P-k 


z=0 


[ P \ 





(/3-fc-l)!dt(/3-^-i)z-^ 

(36) 

The residual for the pole at z — is positive 
the same value, so they cancel out. 

Putting these three together, we find the inverse trans- 
form: 



-1 fc-/3 



u{k-l3). (37) 
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We have inverted the first term of ( 33 1 . Another inverse 



transform that we need is the foUowing. 



iV(0) 



N{0) + at 



k\ 



(38) 



Using these two results, the inverse transform of (33 1 
becomes: 



_ N{{)) + at I 13 



{N{Q)+at)P 
(3{N{0) + aty 

k-P+l 



Uk * 



fc! 



/3 + 1 



u{k — * 



/31n(l 



N{0) 



kl 



(39) 



Then we divide by the total number of 
nodes N{t) — N{0) + at to get the degree distri- 
bution: 



Pk[t) = 



/3 V/3 + 1 
N{0) ^ 



u{k~ (i) 



iV(0) +at. 



/31n 



N{0) 



k \ 



fc! 



iV(0) + atj /? 



/3 + 1 



k-l3+l 



u{k — /?) * 



fc! 



(40) 



Now let us look at the long-time behavior of the re- 
sult. When f — oo, the second and the third terms 
vanish. The first term prevails and tends to the follow- 
ing: 



Pk{t) 



1 



k-li+l 



u{k~ P). 



(41) 



Note that for the case oi P — 1, the same asymptotic 
distribution is obtained as the previous section. Also 
note that in the asymptotic limit, all nodes have degree 
at least /? and the fraction of nodes with degree less 
than B tends to zero. 




150 



Time 



FIG. 3: Growth under uniform probabilities and multiple 
attachments with /3 = 3 and a = 1, on a ring of 30 nodes. The 
fractions of nodes having degree 4,5,6,7 are depicted in time. 
The results are averaged over 30 Monte Carlo trials. 



0.25 



0.15 




0.05 



FIG. 4- Degree distribution at time t = 30 for a 6— regular 
graph, subject to growth with uniform probabilities and multiple 
attachments. The value of fi is 3 and o = 1, The results are 
averaged over 30 Monte Carlo trials 



Fig. (|3| shows the simulation results for a ring of 
30 nodes, and Pk{t) is depicted versus time, for fc = 
4, 5, 6, 7. Fig. Q shows Pfe(t) for t — 30, for a 6— regular 
graph of total 30 nodes. The number of Monte Carlo 
trials is 30 for both cases. The value of /3 is 3 for both 
cases. 



III. PREFERENTIAL LINKING 

In this section we are going to focus on preferential 
attachment. New nodes, instead of selecting from the 
existing nodes uniformly at random, assign to them 
probabilities of connection, proportional to their de- 
grees. So, each existing node has the chance of receiv- 
ing a link from the newly-introduced node equal to its 
degree, divided by the sum of the degrees of every ex- 
isting node. First we will assume the case where a new 
node only attaches to a single existing node, and then 
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the case of multiple connections is considered. 



tion, for further details. 



A. Single Connection 

As mentioned above, in the preferential attachment 
scheme, an existing node with degree k receives a link 
with probability k/ ^g£N(, where the denominator is 
the sum of the degrees of all existing nodes. So the 
probability that the destination node selected by a 
newly-born node has degree k is equal to kNk/J2e 
Using the same approach that led to ([S]), we arrive at 
the following differential equation for the evolution of 
Nuit): 



a 



{ik-l)Nk-i-kNk)+aSk, 



(42) 



Now to proceed as before, we take the Z-transform 
of this equation. First note that if X(z) is the Z- 

transform of a discrete function Xk, then —z '^'^^Jf'^ is the 
Z-transform for the the function kxk- This means that, 
if the Z-transform of Nk is ^'{z), then the Z-transform 
of the first term on the right hand side is as follows: 



(fc-i)7Vfc_i-fc7Vfe A(z-i) 



dz 



(43) 



Second, note that the denominator of the attachment 
probabilities, '^^iNi^ is twice the number of links in 
the graph. Let us denote the number of links in the 
graph by L{t). Note that, since each new node adds 
one new link, we have: 

L{t) = L(0) + at=^ 2L{t) = 2L(0) + 2at. (44) 

Twice the number of links in the initial graph equals 
A''(0)fco) where ko denotes the average degree of the 
initial graph. So we get: 

2L{t) = N{0)ko + 2at=^Y^ iNe = ^¥(0)^0 + 2at. 

(45) 



We will temporarily use 



A =^A^(0)fco 



for brevity. The Z-transform of (42 1 is: 



dip a{z — 1) d'ip 
~dt \ + 2at~dz 



(46) 



(47) 



This is a first-order partial differential equation. We 
will solve this equation using the method of character- 
istics. For the convenience of the reader, we briefly shed 
light on how this method works through a simple exam- 
ple in the appendix. We refer the reader to [I51 - f5Uj . or 
other elementary references on partial differential equa- 



We have the following system of equations: 

dz dip 



dt 
T 



\+2at J 



(48) 



The simplified version of the first equation is the fol- 
lowing: 



dt 



-dz 



(49) 



X + 2at a(z-l)' 
Whose solution is the following: 

(z- l)2(A + 2at) = C, (50) 
where C is a constant. The second equation is: 

dip —dz 



-(A + 2at). 



(51) 



az 1 a(z — 1) 
Replacing (A + 2at) by C/ (z — l)'^ yields the following: 

~Cdz 



z{z — ly 

Integrating both sides, gives: 
-1 1 



%p-C 



z-1 2(z-l)2 



In 



z~l 



(52) 



C, (53) 



where C" is another constant. Following the lines of the 
example, we know that the solution has the following 
form for some function $(•) which must be determined 
from the initial conditions: 



ip-C 



1 



-1 



z-l 2(z- 1)2 



-In- 



z-l 



= $ 



{z-lf{\+2at) 
(54) 



Replacing C from (50 1 we get: 
^[{z-lf{\ + 2at)\ ^ip{z,t) 
- (A + 2at) 



{z-l) + \ + {z-lf\n-^^ 



(55) 



We must determine the function $(•). Suppose the iV^s 
at the outset are known, so that for the initial graph 
we know ip{z,Q). Let us denote it by iPq{z). Setting 
t = in ([55|) we get: 



- A 



(z-l) + l + (z-l)2ln-^ 



(56) 



This helps us determine the function ^{X). Denoting 
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(z — 1)^A by X, we get: 



X 1 X, Vx + \/a' 



Since in ( [55| we have [(z — 1)^A] as X, let us explicitly 
find $((z - 1)2A). We have: 



-A 



, ^. .X + 2at 
(z-1)^/ ^ + 1 



(z-1) 



A + 2at 1 



A 



.oA + Sai (z - l)VA + 2at + VA' 
+ (z - 1) 



A 



In- 



(z - 1)VA + 2at 



(57) 



We plug this expression in ( 55 1 and arrive at 



(z-1) 



A + 2Q;t 



A 



1 , ,2A + 2Q;t, (z- l)VA + 2a< + VA 
— h ( z — 1 ) ^ In , 

2 ^ ^ A (z- l)VA + 2at 



Tp{z,t) - {X + 2at) 



l-z+l + (z-l)^ln-^ 



(58) 



Now, let us make the following simplifications 

1 



, (z- l)V\ + 2at + y/X , 

In , = In 

(z - l)VA + 2ai 



In = -ln(l - z-i). 

z — 1 



1 



A 



z - 1 V A + 2at 



(59) 



Using these simplifications and rearranging the terms 
in (58), we get: 



, , A + 2at 



- 2at{z -I) +at 



2a2(z - 1)2 ln(l - z^^) + (z - 1)A 
A(z-l)-A(z-l)2ln(l-z-i) 

(z- l)2(A + 2at) In 



A + 2Q;t 



A 



A 



1 



z - 1 V A + 2Q;i 



(60) 



Note that from the argument of the logarithm which 
was a result of integration, we know the region of con- 
vergence of the Z-transform is z > 1, since the loga- 
rithm is not defined otherwise. Now let us define the 
new variable 



c{t) 1 



A 



A + 2at 



(61) 



This quantity is positive and less than unity at all times. 
Now, note that we have: 



1 



A 



1 ~ cz-i 



z - 1 V A + 2ai 1 - z" 



, , A + 2at z — c 



(62) 



So we simplify (60) further and arrive at: 
ip{z, t) = ipo (^^ — - 2at{z -l) + at 
- (A + 2at){z - if ln(l - z^^) + A(z - 1) 



A(z- 1) - {\ + 2at){z-lf\n 



1 — cz 
1 - z- 



A + 2at 
A 

(63) 



Note that the two ln(l — z~^) terms cancel out. Also, 
note that there are three terms having the factor 
(z — 1). These three terms add up to: 



- 2a<(z - 1) + A(z - 1)-^/ _ A(z - 1) 



= (z - iy\ + 2aty^/X - VA + 2at 
= -(z- l)(A + 2ai)c 



(64) 



These simplifications transform ( 63 ) into the following: 

-0(z, t) = ( ^^—^ ) + at - (z - 1)(A + 2at)c 



-(A + 2ai)(z-l)2ln(l-cz~i). (65) 

Since c < 1, Vt and z > 1, we have cz~^ < 1. So the 
logarithm can be Taylor-expanded. For ln(l — x) with 
\x\ < 1 we have: 



ln(l — x) ^ —X 

Using this, we have: 

(z-l)2ln(l-cz-i) 



(66) 



2 c 



c 

cz 

2 

c^z-i 



c^z-i 


c^z-^ 


3 


4 






c^z^^ 


c4z-3 


3 ' 


4 



(67) 



Using this expression for the term with the logarithm 
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in (65), we get: 

ip{z, t) = Vo — + - (z - 1)(A + 2at)c 
+ (A + 2at)\cz^^ + 



(68) becomes: 



2{\ + 2at)[c + 



c^z- 


-2 c3 
- + — 


z 




+ 2 




3 




C 


3^-1 


c 




2+- 


3 + 




4 




c^z^ 


2 


c^z^^ 


2 


+ 3 




+ 4 • 



(68) 

Note that this expression seemingly embodies terms 
with nonegative powers of z. Since the sequence of 
degree population N]^ is zero for nonpositive values of 
k, the Z-transform is expected to only exhibit nega- 
tive powers of z. So let us explicitly examine these 
terms and check that they do add up to zero. So let us 
rewrite the terms which embody nonnegative powers of 
z, which are: 

at - (z - 1)(A + 2at)c + (A + 2at)cz 

^2 



+ (A + 2at) — - 2(A + 2at)c 
= at - (A + 2at)c + (A + 2at) ' 



(69) 



The z"*^ term readily vanishes. Now we focus on the 
constant terms. Using the fact that 



(A + 2at) y = A + at - VaVA + 2at, (70) 

we have: 



at - (A + 2at)c + (A + 2at) — 
= -(A + 2at)c + A + 2at - ^/\^/\ + 2at 

= 0. (71) 
So these terms do cancel out. Using this simplification, 



V'(z,t) = -00 



1 -c 



+ (A + 2at) 
- 2(A + 2at) 



cz ^ + 


c^z-^ 


(?Z ^ 


2 + 


3 ' 


'c^z~^ 


c4z-2 


e'z"'^ 




^ 4 - 


' 5 


\r 


c^z^2 


c^z^ 




+ 3 


+ 4 



(72) 



which can be expressed in the following compact form: 

1p(z,t) = tpQ 



(A + 2at) ^ 



k=l 



C C 

^ ' "fc " k + 1 ^ k + 2 



(73) 



Now we have to take the inverse Z-transform. The sum 
on the right hand side is readily in the form of an ex- 
pansion on z^^. We focus on the first term on the right 
hand side. Let us denote the number of nodes in the 
initial graph who have degree k by Nk{0). Then by 
definition, we have: 



V'o(^)=^iVfc(0)z-^ 



(74) 



If we change the argument of ip from z to j^^, we have: 



00 



1 - c 

The inverse transform is given by 

1 - c 



(75) 



z — c 

(i-cY 



(76) 



for a dif- 



Note that the residue of the function 

ferentiable function /(•), is given by ^^niyr: evaluated 
at z = c. For our problem, /(z) ~ z^^^ . So we have to 
evaluate the (£ — l)-th derivative of the function z^^^ . 
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We have: 



1 S'- 
(e -1)1 dz(^- 



{£-i)i{k~iy: 



e>k 



e<k. 



(77) 



Using this, we find the integrals in ([76| and arrive at: 



(fc-^)!' 



(78) 



So the inverse Z-transform of (73) becomes: 



7Vfc(t) = ^A^,(0)(l-c)^c' 



1 



„k+2 



+ (A + 2at)^--2— + — 
Replacing A by N{0)ko, we get: 



(79) 



„fc+2 



(80) 



Now to get the degree distribution, we divide this ex- 
pression by the number of nodes at time t, which is 
equal to N{0) + at. As above, we denote the degree 
distribution of the initial graph by n^, that is, rik is the 
fraction of nodes at the outset with degree k. Thus the 
final result for the degree distribution is: 

' N{0)+at ^ \£-lJ^ ' 



N{0)ko + 2at ( c- 
iV(0) + at 



„k+2 



Combining m\V and ( 46 1 , we get 



^(O)fco 



7V(0)fco + 2at 



(81) 



(82) 




FIG. 5: Degree distribution at time t = 30 for a 6— regular 
graph, subject to growth with preferential probabilities and 
single attachments, a = 1 and results are averaged over 30 
Monte Carlo trials. 



Note that as i — J' oo we have: 



lim^^ 

t->oo N{Q) +at 



= 



N{0)ko + 2at 

lim = 2 

t->oo iV(0) + at 



lim c = 1. 

)-oo 



(83) 



Thus, the asymptotic behavior of the degree distribu- 
tion is given by: 



lim pk{t) - 2 ( 



which simplifies to 

lim pk{t) 



1 



1 k 



k{k + l){k + 2) 



(84) 



(85) 



As we mentioned previously, this asymptotic result 
was derived in [38^ i39l |4T] . Also, for large values of k, 
this pertains to the k~^ power law derived in 

Fig. ([5| illustrates the simulation results and theo- 
retical predictions for a ring of 30 nodes, and Pfc(i) is 
presented as a function of time, for fc = 2, 3, 4. Fig. ^ 
shows Pk{t) for t = 30, for a 6— regular graph of total 
30 nodes. 



B. Multiple Connection 



Now let us consider the preferential attachment 
scheme again, but this time, each new node attaches to 
/3 existing nodes. This means that at time t, the num- 
ber of nodes will be A^(0) -I- 2at. Also, at time t, the 
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k=3 



- ■ » » ■ ■ «_i 



50 
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FIG. 6: Growth under preferential probabilities and single 
attachments, on a ring of 30 nodes. The fractions of nodes 
having degree 2,3,4 ^'''^ depicted in time, a = 1 and results are 
averaged over 30 Monte Carlo trials. 



sum of the degrees of all nodes (which equals twice the 
number of links) will be A^(0)fco + '2,apt. Each newly 
born node adds one to at that instant. Let us once 



again denote 7V(0)fco by A. Similar to (42), the evolu- 
tion of Nk{t) is 



a(3 



{{k - l)Nk^, - kNk) + a5k,p. (86) 



Taking the Z-transform leads us to: 

aP{z — 1) dijj 
~di ~ X + 2al3t Ih 

Using the method of characteristics, we have 

dz dtp 



az 



(87) 



dt 
T 



aJ3{z-l)l 
\+2apt J 



az' 



The first equation yields a similar result as the previous 
section: 



{z-lf{\ + 2al3t) = C. 
The second equation is the following: 

dil: —dz C 



-P a/3(z- 1) (z- 1)2 



Let us define: 



F{z) 



dof 



{x-iy 



rdx. 



Then we have: 



^{z,t)^-^F{z) + ^C). 



(89) 



(90) 



(91) 



(92) 



This can be used to determine the unknown function 
<&(•). For t = we have: 



Mz)+^-^^F{z)^^[{z~lfX]. 
From this, we find that the function ^{X) is 

fx 



1 



(93) 



(94) 



150 Substituting C for X, (92 1 transforms to 



^(z,t)=^o((^-l)A/^^^^ + l 



(z- l)2(A + 2a/3i) 



/ / ^ / A + 2aBt 

F{z)-F[ (z-i)^ — + ^ 

(95) 



Let us generalize (61) and define the following: 

dcf , / A 

c = 1 — 



A + 2al3t ' 



(96) 



As above, this quantity is less than one and tends to 
one as t — >■ oo. Then (951 is simplified to: 



^/'(z,<) = Vo 



1 - c 



(z- l)2(A + 2a/3t) 



F(z)-F 



1 - c 



(97) 



Now let us plug in the explicit form of F{z). We 
found the result through speculation, by looking at the 
first few /3s. The solution is: 



1 



^^^^ ' (a;-l)3'^^" z-1 2(z-l)2 



1 i-l (/3-t)(g-t + l) __^^ 



k=l 



(98) 



Multiplying by [z — l)^ as appeared in (97), we have: 

G{z)''^'{z-lfF{z) = 

2 2 



4 + ^^(-l)^ln(l-z-) 



1^ (/3-fc)(/3-fc + l) 

2 ^ k 

fe=i 



{z"^ -2z + l)z-^. (99) 



Now let us focus on taking the inverse Z-transform of 
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G{z). Expanding the logarithm, we have: 

G{z)^p{z-l)-\ 



/?(/3 + l) 



3 



'-{z^-2z + l)z-\ (100) 



k=l 



Note that the terms involving nonncgative powers f z 
must vanish, as above. First, let us look at the terms 
in G{z). The second term gives: 



(101) 



The third term in (100), gives two z'^ terms, one for 
m — 1 and one for m = 2. We have: 



(/3-2)(/3-l) 



/?(/?- 1). 



(102) 



So the total term of G{z) is: 



+ ^ + (103) 

One can readily check that they do add up to zero. 

Now let us examine the z^ terms in G{z). The second 
term in ( 100 ) gives: 



/?(/? + 1) 



(-Iz). 



(104) 



The summation yields a term only for m = 1. This 
term is: 



/3(/3-l) 



iz). 



(105) 



Plugging these in (100), we find that the total z^ por- 
tion of G{z) is: 

^=+W+ll(-l=) + «^W. (106) 
which adds up to zero. 



To take the inverse Z-transform of ( 99 ), let us rewrite 
it as follows: 



G(z) = 



/3(^ + l) V-.-fc 



fc=i 



1 2 1 

k ^ k + l ^ fc + 2 



r^'(^^M|^i±ll(z^-2z + l)z-. (107) 



fe=i 



It can be further simplified as follows: 



G(z) 



/?(/? + 1) 



-2 



fe=i 



,-fe 



/s(/c + l)(fc + 2) 



1 '^"^ 



fc=i 



_J (/?-fc)(/3~A: + l) 



J/3-fc-l)(/3-fc) _^ (^- fc - 2)(/3 - fc - 1) 



fc+ 1 



(fc + 2) 



(108) 



Taking the common denominator of the terms inside 
the summation, this expression is simplified further and 
transforms to the following: 



G{z) = 



-2 



E^ 

k=l 



,-fe 



fc(fc + l)(fc + 2) 



1 '^-^ 



fe=i 



-fe 2/3(/? + l) 
fc(fc + l)(fc + 2) 



(109) 



Since the terms are identical, G{z) simplifies to the fol- 
lowing compact form: 



+ _^-fe_ 



fe=i 



fc(fc + l)(fc + 2) 



(110) 



Taking the inverse Z-transform is straightforward: 
, -/?(/? + 1) 



G(z) 



fc(fc + l)(fc + 2) 



u{k- P). 



(Ill) 



Getting back to (97), we can rewrite it as follows: 



ipiz^t) = -00 



z — c 
1 - c 



(A + 2a/3t) 



G(z) - (1 - c)2g 



1 - c 



Note that we have: 

(1 - cf 



A 



A + 2a/3r 



(112) 



(113) 



so (112) is further simplified: 



Vi(z,t) = 00 



1 -c 



(A + 2a/3t) 



G(z) 



A 



G 



A + 2a/3t V 1 - c 



z — c 



(114) 



We have previously taken the inverse transform of the 



first term in ( 80 ) , which was given by ( 78 ) . Using the 



same procedure, we know how to extract the inverse 
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transform of a function whose argument is [ | , once 

the inverse transform of the function is known. That 
is, knowing the inverse transform of G{z), we can find 

Let us denote the 

inverse transform of G{z) by gk- Then we have: 

G(^)^^g,(l-c)V-^f^:j). (115) 



the inverse transform of G\ 



1 - c 



e=i 



Using this, along with (111), we take the inverse Z 



transform of (114). Also, let us replace A by iV(0)fco. 



We wind up with: 

k 



fc- 1 



{N{0)ko + 2al3t) + 1) 

/3 fc(fc + l)(/c + 2) 

iV(0)fco ^ /3(/3 + l) , 

P £^^(^+l)(^ + 2)^ ^ V^-1 



uik - P) 

fc - 1 



Finally, dividing (116) by the number of nodes at 



time which is equal to A^(0) + at, yields the degree 
distribution at time t. As above, let us denote the 
degree distribution of the initial graph by Uk ■ The final 
result for the degree distribution is: 



Pk{t) 



NiO) 



N{0)+at 
(7V(0)fco + 2al3t) 



^n,(0)(l-c) 

£ 



fc- 1 

£-1 



N{0) + at fc(fc + l)(fc + 2) 

k 



u{k - P) 



(/?- 



(117) 



Now let us focus on the long time behavior, when 
t — >■ oo, we have: 



N{0) 



Van , , 
t^oo 7V(0) +ai 







^.^A.(0)fco + 2./3t^ 
t^oo 7V(0) + 



(118) 



lim c—\. 



Using these values, the asymptotic degree distribution 



0.25 



0.15 




0.05 



FIG. 7: Degree distribution at time t = 30 for a regular 
graph, subject to growth with preferential probabilities and 
multiple attachments, with /3 = 3. The value of a is 1, and the 
results are averaged over 30 Monte Carlo trials. 



(116) 




FIG. 8: Growth under preferential probabilities and multiple 
attachments, on a ring of 30 nodes. The fractions of nodes 
having degree 2,3,4 (""g depicted in time. The value of p is 3 
and the value of a is 1. The results are averaged over 30 
Monte Carlo trials. 



is obtained: 

lim pkit) 



2/3(/3 + l) 



fc(fc + l)(fc + 2) 



u(fc-/?). 



(119) 



which matches ([2|. 

Fig. ([7| is a depiction the simulation results and the- 
oretical predictions for a ring of 30 nodes, and Pk{t) is 
presented as a function of time, for fc = 2, 3, 4. Fig. ([s]) 
shows Pk{t) for t — 50, for a 6— regular graph of total 
30 nodes. The value of /? is 3 in both cases. 



IV. SUMMARY AND FUTURE WORK 

Previous work in the literature of network growth 
models mainly focus on the degree distribution of the 
graph in the asymptotic limit, that is, when the num- 
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ber of nodes tends to infinity and the effect of initial 
conditions can be neglected. In this contribution we 
found exact expressions for the expected degree distri- 
bution, which depend explicitly on the degree distri- 
bution of the initial graph. We considered two growth 
schemes. One in which new nodes choose from existing 
nodes uniformly at random, and then connect to them, 
and the other where these probabilities are proportional 
to degrees. Uniform and multiple attachments for the 
newly-born nodes are considered separately for both 
cases. Simulation results were accompanying theoreti- 
cal predictions for each case. 

One possible extension of the results presented in 
this work would be as follows. Suppose a given graph 
is subject to growth. The current state of the graph 
is known, and the growth mechanism can be approx- 
imated to be uniformly at random or be preferential 
attachment. Suppose quite on the contrary to the pre- 
vious work in the literature, we are interested in the 
short-time behavior of the degree distribution. Then 
one could employ the results in this work, and expand 
the expressions in the vicinity of the initial condition 
up to arbitrary order of {at)/N{0), and find the degree 
distribution perturbatively, to arbitrary precision. 

Our analysis focuses on the expected degree distri- 
bution, pk (t) has a distribution of its own, whose mean 
value is presented in this work. One can also focus 
on the variance, or other statistical properties, of this 
distribution. 



Then the solution is of the form: 
F{Ci) + G{C2) 



0, 



(A5) 



for any differentiable function F{-) and G{-). This is 
equivalent to: 

C2^H{Ci), (A6) 
for an arbitrary function H{-). This means that: 

1 1 N 



1 1 



H 



This can be simplified to give: 



^3 2y^^^^^x 2^2)' 



(A7) 



(A8) 



Denoting 3H{-) by <&(•): the final solution can be ex- 
pressed in the following general form for any differen- 
tiable function $(•): 



3 



$( 



(A9) 



The function $(•) is uniquely determined using the 
boundary conditions. Suppose we have the following 
information for the x = I boundary: 



V'(l,2/) 



(AlO) 



Appendix A: Method of Characteristics 

Here we illustrate the basic procedure with an exam- 
ple. Consider the following partial differential equation 
for a function ijj{x, y): 

^2d^ix,y) , .,3 5'/'(x,y)^^4(^^^) ,x>l,y>0. 



dx 



dy 



First we solve the following system of equations: 
dx dy dip 

X^ y3 ^4 

The first equation is solved as follows: 

1 1 



dx dy 

X^ y3 



X 2y2 



(Al) 



(A2) 



(A3) 



where Ci is a constant. For the next equation we have 
(we arbitrarily pick one of the two remaining equa- 
tions): 



Plugging X — 1 in ( A9 ) yields 

" 3 



. $(1 

2y2 V 0,,2' 



1 

V 



Simplifying this, we get: 
1 - 



$ 1 



-3y 



2y2 



2y2 



If we denote 1 — by X, then y 
arrive at: 



2(1-X) 



(All) 

(A12) 
So we 



^{X) = exp 



2(1 -X) 



3(1 -a:). (A13) 



This $(•) provides the unique solution of the form ( A9 ), 
given the boundary condition ?/;(l,y) = e^. This con- 
cludes the example. 
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